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EXECUTIVE  SUMMARY 


Resolution  of  these  issues  will  be  difficult  because  the  LHX's  mission  and  tech¬ 
nologies  extend  well  beyond  those  with  which  the  military  and  human  factors 
engineering  communities  are  fami 1 iar , .the  system's  mission  has  yet  to  be  fully 
defined,  and  there  are  no  rotorcraft  pilots  experienced  with  the  demands  of 
flight  and  mission  management  within  the  system.  As  a  consequence,  human 
factors  engineering  of  the  system  cannot  rely  on  extant  knowledge  of  the  work¬ 
load  demands  of  rotorcraft  piloting.  A  new  approach  is  required.^ 

Bio-Dynamics  recommends  a  seven-step  approach  to  the  ^nady^TTCn^resolut ion 
of  the  LHX  pilot  workload  problem.  Two  key  considerations  underlie  the 
approach.  First,  valid  assessments  of  workload  and  automation  opportunities 
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within  the  LHX  system  can  only  be  achieved  through  use  of  a  physical  model 
(simulator)  of  the  «ysrem  so  that  objective  performance  measures  can  be  acquired 
to  substantiate  subjective  judgements.  Second,  due  to  the  enormous  cost  of  high 
fidelity  simulation  in  this  field,  the  development  and  use  of  easily  modifiable, 
low-cost  computer  simulations  —  to  identify  the  most  effective  modes/forms  of 
information  presentation  and  control  capability  to  incorporate  into  the  high 
fidelity  simulator  —  must  be  an  essential  aspect  of  the  proposed  solution. 

The  seven  steps  entailed  in  the  proposed  program  are  as  follows: 

Step  1 :  Expert  elicitation 

The  objective  of  expert  elicitation  within  the  present  approach  is  to  gain  from 
experienced  pilots  a  detailed  picture  of  the  information  gathering  and  control 
activities  associated  with  flight  and  mission  management  within  each  of  a  set 
of  representative  LHX  mission  scenarios.  Of  specific  interest  is  information 
on  the  procedu-es,  (likely)  task  concurrencies,  task  priorities,  performance 
criteria,  and  modes  of  information  representation  governing  the  pilot's  per¬ 
formance  to  be  used  during  subsequent  steps  to  identify  1)  the  most  important 
pilot  information  gathering  and  control  functions  to  focus  o‘n  during  simulator 
construction,  2)  alternative  modes/forms  of  information  presentation  and  control 
to  simulate  and  analyze,  and  3)  performance  measures  to  be  used  during  the 
conduct  of  this  analysis. 

Step  2:  Principled  Analysis  of  Elicitation  Data 


The  objective  of  this  step  is  to  perform  an  analysis  that  will  identify  the 


information  gathering  and  control  functions  needed  for  incorporation  into  simu¬ 
lator  design,  to  identify  alternative  modcs/forms  of  these  functions  to  model, 
and  to  comparatively  evaluate  within  the  simulator  the  tasks  and  performance 
measures  to  be  used  during  task  evaluations. 

The  analysis  would  incorporate  the  following  information,  acquired  during  Step 
1: 

a.  a  specification  of  each  of  the  pilot  tasks  identified  within  the 
scenarios  studied,  including  the  information  needed  and  action  required 
to  complete  the  task  successfully; 

b.  a  listing  of  all  (likely)  task  concurrencies; 

c.  the  key  performance  criteria  (error,  timing  or  latencies  tolerances) 
associated  with  each  task  under  each  of  its  various  concurrencies; 

d.  the  relative  priority  of  each  constituent  task  for  concurrent  tasks. 
These  relationships  and  the  principles  of  cognitive  and  human  factors  psychology 
that  can  be  brought  to  bear  on  them,  would  define  a  set  of  constraints  to  serve 
as  critical  design  criteria  during  efforts  to  identify  alternative  modes/forms 
of  information  presentation  to  be  simulated  during  project  Step  3. 


Development  of  Low-Cost  Simulations 


The  objective  of  Step  3  is  to  produce  computerized  simulations  of  the  alterna¬ 
tive  means  of  information  presentation  and  control  emerging  from  the  Step  2 
analysis.  Because  these  simulations  will  be  used  to  comparatively  evaluate  the 
alternatives  specified  during  Step  2,  they  must  include  the  capacities  to: 
a.  score  task  performance  along  the  critical  performance  dimensions 
identified  during  Step  1; 


b.  flexibly  combine  tasks  to  form  the  concurrencies  identified  in  Step 

1; 

c.  flexibly  combine  the  information  presentation  and  control  alternatives 
specified  in  Step  2  to  variously  configure  each  task  studied. 

Stcp_  Test  Subjects  on  Low-Cost  Siinu  1  at  ions 

The  objective  of  Step  4  is  to  empirically  compare  the  information  presentation 
and  control  alternatives  identified  in  Step  2.  The  results  of  these  comparisons 
will  be  an  identified  set  of  information  presentation  and  control  modes/forms 
yielding  the  most  effective,  single  and  concurrent  task  performance  (as  defined 
by  the  single  and  dual  task  performance  criteria  identified  in  Step  1)  among 
those  alternatives  considered.  The  type  of  information  being  sought  in  this 
step  is  of  the  form,  "performance  on  task  combination  A  and  B  is  better  when 
task  A  information  is  presented  in  mode  X  as  opposed  to  Y  or  2".  However,  since 
the  simulations  producing  these  results  will  not  be  high  in  fidelity,  it  is 
inappropriate  to  draw  conclusions  about  absolute  levels  of  performance  from 
these  low-cost  simulations  requiring  additional  steps. 

Step  5;  Configuration  of  High-Fidelity  Simulation 

The  objective  of  Step  5  is  to  implement  the  optimal  solutions  identified  in  Step 
A  as  components  in  a  high-fidelity  simulation  that  can  be  used  for  evaluation 
of  automation  needs  within  the  LHX  system.  The  assumption  underlying  this  step 
is  that  neither  subjective  judgments  drawn  from  pilots  whose  experience  is  in 
helicopter  systems  other  than  the  LHX,  nor  analysis  based  on  the  application 
of  psychological  principles  to  judgmental  data  elicited  from  expert  pilots,  is 
sufficient  a  priori  to  produce  sound  decisions  regarding  automation.  The  most 


4 


valid  procedures  for  determining  which  LHX  pilot  functions  to  automate  are  those 
based  on  analysis  of  the  performance  and  subjective  judgments  of  pilots  func¬ 
tioning  within  an  implemented  system  whose  workload  demands  simulate  those 
anticipated  within  the  l.HX  itself. 

Step  6 ;  Performance  _Te  s  ting_i  n  Baseline  LHX  Si  mu  1 ^_t  or 

The  information  display /control  suite  of  the  simulator  configuration  developed 
in  Step  5  will  serve  as  a  baseline  suite  in  •  ;.e  sense  that  it  will  contain  no 
automated  pilot  functions.  The  objective  of  Step  6  is  to  conduct  performance 
testing  with  skilled  pilots  to  gather  performance  data  and  expert  judgments  that 
can  be  used  to  guide  decisions  on  automation.  If  skilled  helicopter  pilots, 
reasonably  trained  on  the  baseline  simulator,  fail  to  perform  the  constituents 
of  a  set  of  concurrent  tasks  within  specified  tolerances,  then  some  member(s) 
of  the  concurrent  set  must  be  considered  for  automation. 

Step  7:  Modification  and  Re-evaluation  of  the  LHX  Simulator 

Based  on  performance  data  and  pilot  assessments  (Step  6)  and  technological 
feasibility,  certain  pilot  functions  in  the  baseline  simulator  will  be 
"automated"  for  further  study  using  a  modified  simulator.  Skilled  pilots  will 
be  tested  on  the  up-graded  simulator  to  determine  whether  or  not  the  automation 
produces  acceptable  levels  of  performance.  Based  on  the  results  of  this  evalu¬ 
ation,  further  system  refinement  will  be  carried  out  as  necessary. 


1.  INTRODUCTION 


1.1  Overview 

The  Army's  family  of  light  scout-attack  helicopters  (LHX),  planned  for  de¬ 
ployment  in  the  1990's,  will  fly  nap-of^the-carth  (NOE)  missions  in  high 
threat  environments,  often  under  poor  visibility  and  adverse  atmospheric 
Conditions,  and  probably  with  a  one  man  crew.  The  obvious  complexities 
of  flight  and  mission  m’nagement  under  these  conditions  raise  two  human 
factors  issues  that  are  critical  to  success  of  the  LUX  mission: 

1.  How  should  the  LHX  information  display/control  suite  be  designed 
to  optimize  its  compatibility  with  the  information  handling 
capabilities  of  the  pilot? 

2.  What  information  processing  functions  within  the  LHX  system  should 

■  be  automated  in  order  to  ensure  the  pilot's  mental  workload  under 

high-stress  conditions  remains  within  acceptable  limits? 

Bio-Dynamics'  objective  for  the  present  study  is  to  describe  a  procedure 
for  the  analysis  of  pilot  workload  that  will  identify  and  explicate  the 
demand  characteristics  of  those  LHX  mission  components  holding  overload 
potential.  A  major  claim  in  the  presentation  that  follows  is  that  a  prin¬ 
cipled,  in-depth,  explication  of  the  cognitive  demands  of  LHX  piloting  is 
essential  to  any  effective  effort  to  address  the  human  factors  issues 
listed  above.  Two  previous  studies  have  addressed  these  issues,  one  by 
Honeywell  (1982),  the  other  by  Perceptronics  (1984).  While  the  solution 
methodologies  advocated  in  these  two  studies  have  much  to  recommend  in 
their  treatment  of  the  demands  of  piloting,  they  fail  to  achieve  the  level 
of  detail  needed  to  map  those  demands  effectively  into  established  know- 
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lodge  and  principles  of  human  information  processing.  As  a  consequence, 
neither  approach  has  succeeded  in  taking  full  advantage  of  the  data  and 
understanding  available  in  the  fields  of  cognition  3nd  human  performance. 
The  focal  aim  of  the  current  effort  is  to  describe  a  task-analytic  proce¬ 
dure  that  will  yield  the  detail  and  organization  needed  to  achieve  this 
mapping. 

Bio-Dynamics'  current  effort  paves  the  way  for  a  multiple  step  approach 
to  treat  these  mission  critical,  pi 1 ot -machine  interface  and  automation 
issues.  Several  variants  of  the  suggested  approach  are  imaginable.  One 
variant  is  as  follows:  Initially,  expert  pilot  opinion  on  projected  LHX 
fl ight  and  mission  management  is  integrated  with  relevant  principles  of 
cognitive,  human  performance,  and  human  factors  psychology  to  define  a 
plausible  set  of  alterna'.ive  information  presentation  and  control  modes/- 
forms  for  further  evaluation.  These  alternatives  are  then  implemented  as 
modular  components  in  a  relatively  low-cost,  ccmputer-control led  simulator. 
The  simulated  alternatives  are  comparatively  evaluated  with  respect  to  the 
quality  of  operator  performance  obtained.  The  modes/forms  of  information 
presentation  and  control  yielding  the  most  effective  user  performance  are 
then  implemented  within  a  high  fidelity  baseline  simulator  containing  only 
baseline  levels  of  automation.  Objective  performance  measures  and 
subjective  ratings  taken  from  pilots  tested  in  the  baseline  simulator  are 
then  used  to  determine  the  need  for  additional  automation  within  the  simu¬ 
lator.  The  performance  and  subjective  reactions  of  pilots  in  t:.e  resulting 
(computer  augmented)  simulator  would  then  serve  to  guide  further  refine¬ 
ments.  The  end  product  is  conceptualized  as  an  empirically  validated  model 
for  LHX  information  display/control  suite  design  and  system  automation. 


Two  key  considerations  underlie  this  approach  and  any  plausible  version. 
First,  Bio-Dynamics  believes  that  valid  assessments  of  workload  and  of 
automation  opportunties  within  the  LHX  system  cannot  be  achieved  in  the 
absence  of  a  physical  realization  (simulator)  of  the  system  within  which 
both  subjective  judgments  and  oojective  perfor.-ance  measures  can  be  taken. 
Second,  there  is  an  enormous  cost  of  high  fidelity  simulation  in  this 
field,  and  therefore  the  need  exists  for  preliminary  use  of  easily  modifi¬ 
able,  low-cost  computer  simulations  of  system  components  to  identify  the 
most  effective  modes/forms  of  information  presentation  and  control 
capability  to  incorporate  into  the  high  fidelity  simulator. 

The  Froblera 

Resolution  of  the  human  factors/automation  issues  surrounding  the  LHX 
system  will  be  difficult  for  several  reasons: 

1.  The  likely  mission  repertoire  of  the  LHX  will  differ  significantly 
from  what  has  been  experienced  by  current  Army  rotary-wing  pilots. 
Therefore,  understanding  the  performance  implications  of  the  LHX 
mission  will  prove  extremely  challenging. 

2.  The  range  of  possible  missions  has  yet  to  be  defined  fully  for 
the  aircraft,  and  mission  scenarios  continue  to  evolve. 

3.  Since  mission  capabilities  are  not  fully  defined,  human  factors 
engineering  criteria  for  the  system  cannot  be  specified. 

A.  Of  those  technologies  that  can  be  anticipated,  many  are  currently 
undergoing  development,  and  therefore  are  unavailable  for  empir¬ 
ical  analysis. 

Consequently,  many  questions  exist  regarding  the  likely  information  pro¬ 
cessing  demands  the  LHX's  technologies  will  impose  on  its  crew.  In  sum, 
workload  analysts  will  have  available  neither  (a)  pilots  or  other  individ- 
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uals  who  are  true  experts  on  the  LHX  system  and  its  demands,  nor  (b)  a  true 
LHX  simulator  within  which  estimates  of  pilot  workload  might  be  obtained. 

These  considerations  clearly  argue  the  need  for  novel  approaches  for  the 
analysis  of  LHX  crew  workload.  Since  neither  the  LHX  system  nor  a  high 
fidelity  simulation  of  it  will  be  realized  in  the  near  future,  it  will  not 
be  possible  to  base  initial  analyses  in  any  close  way  on  experimentally 
derived  performance  data.  Similarily,  since  there  are  no  rotorcraft  pilots 
who  are  experienced  in  the  missions  and  technologies  speci{ic  to  the  LHX 
system,  it  will  not  be  possible  for  initial  analyses  to  rely  entirely, 

.  or  in  a  significant  manner,  on  subjective  workload  judgments.  Rather,  iL 
would  appear: 

1.  that  initial  analyses  must  rely  to  an  unprecendented  extent  on 
the  application  of  principles  drawn  f>-om  research  in  cognitive 
and  human  performance  psychology; 

2.  that  the  mapping  of  such  principles  into  the  LHX  problem  must  be 
constrained  by  an  understanding  of  the  generic  information  acqui- 

» 

sition/analysis  and  control  requirements  of  flight  and  mission 
management  within  the  LHX  system/mission;  and 

3.  that  because  of  the  current  incompleteness  of  the  body  of  princi¬ 
ples  that  can  be  applied  to  the  problem,  and  other  uncertainties 
related  to  the  precision  of  the  principle-to-problem  mapping,  the 
solutions  yielded  by  such  a  mapping  will,  in  many  instances,  need 
to  be  subjected  to  close  empirical  evaluation. 

2.0  Review  of  prior  efforts  to  treat  the  LHX  crew  workload  problem 


Prior  to  considering  the  approach  that  emerges  from  the  foregoing  con' 
siderations,  it  will  be  instructive  to  review  two  earlier  efforts  to 


develop  work  load  analytic  procedures  applicable  to  the  LHX  problem.  These 
two  studies  (Honeywell,  1982;  Perceptronics,  1984)  contain  some  excellent, 
creative  thinking  which  is  taken  advantage  of  in  Bio-Dynamics'  approach. 
However,  the  two  studies  also  contain  serious  conceptual  difficulties  which 
significantly  limit  their  ultimate  utility. 

2.1  The  Honeywell  approach 

2.1.1  Summary  of  the  approach 

In  brief,  the  approach  advocated  by  Honeywell  (1982)  entailed  the  following 
steps: 

1.  Identification  of  crew  tasks.  A  set  of  three  representative  LHX 
mission  scenarios  (projected  by  Boeing  Vertol)  was  subjected  to  the 
analysis  of  an  expert  rotorcraft  pilot.  The  results  of  this  expert 
elicitation,  together  with  information  gathered  from  relevant  written 
material  on  LHX  systems  and  crew  procedures,  were  used  to  identify  a 
representative  set  of  43  crew  tasks  or  workload  demands  within  the  LHX. 
Illustrative  of  these  tasks  are  the  following: 

1.  Flight  control  activities 

a.  descend  to  NOE  .  . 

b.  hover  unmasked 

c.  NOE  flight 

2.  Communications  activities 

3.  Target  acquisition  activities 

a.  activate  automatic  target  recognition  (ATR)  systems 

4.  Assess  damage  to  target 

5.  Threat  warning/counter-measures  activities 

a.  assess  TW  display 

b.  select  weapon 
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6.  Fire  control  activities 


a.  arm  gun 

b.  guide  missile 

7.  Data  management  and  transfer 

a.  soft  failure  cues 

b.  request  status  information 

Definition  of  baseline  information  display/control  suite.  Based  on 
the  task  analysis  carried  out  as  Step  1  and  a  consideration  of  the  LHX 
mission,  as  well  as  existing  and  anticipated  avionics  technologies 
applicable  to  the  LHX,  the  characteristics  of  a  feasible  "baseline" 
information  di  splay/cont rol  suite  were  Jefined.  This  minimally  auto¬ 
mated  baseline  suite  served  as  the  context  o£  Honeywell's  workload 
analysis. 

Identification  of  interface  channels.  Ten  information  flow  interfaces, 
either  to  or  from  the  crew,  were  identified  within  the  baseline  suite. 
Channels  of  information  flow  to  the  crew  were  defined  by  their  sources 
(for  example,  Head-Up  Display,  Head-Down  Display,  Speech  Generator, 
Radio  Communications  In).  Channels  of  information  flow  from  the  crew 
were  defined  by  their  response  modality  and  object  (for  example,  Manual 
flight  controller,  Voice  communications  out,  Manual  discrete 
responses). 

Assessment  of  single  task  workload.  Each  of  the  43  individual  crew 
tasks  identifed  at  Step  1  was  assessed  with  respect  to  the  workload 
demand  imposed  by  the  task  on  each  of  the  10  interface  channels  ident¬ 
ified  at  Step  3.  This  assessment  was  based  on  the  collective  judgments 


of  a  seasoned  helicopter  pilot  and  Honeywell  sraif  knowledgable  in 
human  factors  engineering.  The  assessment  consisted  ol  the  assignment 
of  an  ordinal ly  scaled  value  (0-3)  to  each  interface  channel  for  each 
task. 

5.  Assessment  of  multiple  task  workload.  Workload  under  conditions  of 
task  concurrency  was  determined  by  the  following  rules: 

a.  Consider  cases  in  which  concurrent  tasks  imposed  either  con¬ 
flicting  information  acquisition  demands  (that  is,  one  task 
requires  information  through  the  Head-Up  Display  Channel  and  the 
other  requires  information  through  the  Head-Down  Display  Channel), 
or  conflicting  control  output  demands  (concurrently  utilizing 
Flight  Controller  and  Manual  Discrete  irterface  channels).  In 
these  instances  the  index  of  workload  demand  at  each  of  the 
conflicting  interfaces  is  doubled  to  reflect  the  increased 
demands/costs  of  the  time-sharing  conflict  involved,  and  the  total 
workload  imposed  by  the  tasks  is  set  as  equal  to  the  sum  of  these 
doubled  estimates. 

b.  Consider  cases  in  which  concurrent  tasks  create  conflicts  neither 
in  information  acquisition  nor  in  control  output.  In  these 
instances,  the  total  workload  imposed  by  the  tasks  is  set  equal 
to  the  sum  of  the  workload  ratings  of  the  tasks  when  considered 
in  isolation. 
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6.  Identification  of  high  workload  points  within  representative  LHX 

mission  scenarios.  Ow  result  of  the  analysis  carried  out  at  Step  1 
is  a  second-by-second  listing  of  the  tasks  and  task  concurrencies  that 
might  occur  during  the  course  of  the  LHX  mission  scenarios  provided 
by  Boeing  Vertol.  This  task  listing  was  subjected  to  the  workload 
analysis  developed  at  Steps  4  and  5.  The  results  of  this  analysis 
provided  running  measures  of  instantaneous  (momentary)  and  sustained 
(5-second  averaged)  crew  workload  through  the  representative  scenarios. 
Tasks  occuring  during  intervals  with  instantaneous  workloads  in  excess 
of  an  arbitrarily  chosen  value  were  identified  as  candidates  for  auto¬ 
mation  or  alternate  redesigns  were  selected. 

. 2  Critique  of  the  approach 

The  1982  Honeywell  approach  has  several  commendable  features,  among  them: 

1.  the  effort  thiouphout  the  study  to  anchor  analyses  with  expert 
(rotorcraft  pilot)  judgments; 

2.  the  effort  to  systematically  apply  the  theory  and  data  of  informa¬ 
tion  processing  and  cognitive  psychology  in  workload  analysis; 

and 

3.  the  development  of  a  simple  but  elegant  task-analytic  system  based 
on  information  display/control  interface  channel  utilization. 

While  attractive  along  these  lines,  the  approach  suffers  some  major  diffi¬ 
culties  in  the  method  used  to  assess  workload.  The  analysis  of  individual 
task  workload,  from  which  all  subsequent  estimates  were  derived,  was  based 
on  the  subjective  judgments  of  an  individual  who,  although  a  seasoned 
rotorcraft  pilot,  had  little  or  no  experience  with  many  of  the  tech- 
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nologies,  displays,  and  controls  that  will  be  implemented  in  the  LHX. 
Subjective  estimates  of  workload  have  often  proven  difficult  to  validate 
even  when  judges  are  experienced  in  the  work  situation.  Accordingly,  it 
is  questionable  whether  any  confidence  can  be  placed  in  workload  judgments 
about  complex  settings  containing  unfamiliar  components. 

An  additional  difficulty  found  in  the  Honeywell  approach  relates  to  a 
scaling  issue.  Each  of  a  large  number  of  tasks  were  "workload-assessed" 
in  terms  of  the  ten  display/control  interface  channels  described  earlier. 
The  assessment  tool  consisted  of  a  4-point  ordinal  scale,  where  0  =  no 
workload  imposed  on  the  interface  channel,  and  3  =  high  workload  imposed 
on  the  channel.  These  values,  summed  across  interface  channels,  defined 
the  overall  workload  imposed  by  a  Cask.  Therefore,  some  tasks  might  have 
a  high  indexed  workload  because  they  impose  heavy  loadings  on  interface 
channels  A  and  B,  whereas  other  tasks  are  high  in  indexed  workload  because 
they  impose  heavy  loadings  on  interface  channels  C  and  D.  Thus,  the 
scaling  problem  arises.  On  what  basis  can  it  be  concluded  that  a  high 
loading  (a  score  of  3)  on  interface  channel  A  (the  heads-up  display)  is 
the  same,  workload  wise,  as  a  high  loading  (3)  on  channel  C  (the  flight 
controller)?  In  fact,  such  a  conclusion  cannot  be  reached  on  any  princi¬ 
pled  basis.  Consequently,  it  is  not  legitimate  to  claim  two  individual 
tasks  or  two  task  concurrencies  that  have  total  workload  ratings  derived 
from  different  patterns  of  interface  channel  loading  are  in  fact  equal  in 
true  workload.  This  fact  alone  undermines  the  entire  workload  analysis 
of  the  Honeywell  group. 
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Another  difficulty  of  the  Honeywell  study  relates  to  the  simplifying 
assumption  (Step  5b)  that  concurrent  tasks  not  loading  "conflicting"  input 
or  output  interface  channels  will  not  suffer  from  dual  task  deficits.  This 
assumption  is  invalid.  There  is  ample  evidence  which  proves  marked  dual 
task  interference  between  tasks,  one  which  is  visual  and  one  which  is 
auditory,  or  one  which  is  manual  and  the  other  which  is  vocal  (see,  e.g., 
Greenwald  and  Schulman,  1973);  Karlin  and  Kestenbaum,  1969;  Hawkins  and 
Rodriguez,  1981).  Whereas  tasks  utilizing  common  input  or  output  channels 
will  often  produce  more  dualtask  interference  than  those  not  sharing 
channels,  the  difference  in  measured  interference  between  the  two  situa¬ 
tions  is  often  small  relative  to  the  total  (centrally  mediated)  inter¬ 
ference  produced  by  either  (e.g.,  Hawkins  and  Rodriguez,  1981). 

Finally,  the  Honeywell  analysis  is  based  on  the  assumption  (Step  5a)  that 
task  pairings,  in  which  "conflicting"  input  or  output  channels  are  used, 
will  exhibit  a  multiple  task  cost  fairly  represented  by  a  doubling  of  the 
indexed  single  task  workload  along  the  conflicting  channel(s).  As  a  single 
valued  estimate  of  multiple  task  costs,  doubling  may  or  may  not  be  reason¬ 
able.,  There  is  no  empirical  basis  for  estimating  the  validity  of  this 
pazticular  value.  Regardless,  the  use  of  a  tingle  value  to  estimate  con¬ 
current  task  costs,  regardless  of  the  source  of  the  problem,  represents 
a  gross  oversimplification  of  the  available  data  on  time-sharing  perform¬ 
ance.  Depending  on  a  wide  range  of  factors,  dual  task  costs  in  reaction 
time  and/or  error  rate  range  from  nearly  zero  to  over  1007.. 

Because  of  the  difficultiei  cited  above,  neither  the  single  and  dual  task 
workload  judgments,  nor  tne  overload  determinations  yielded  by  the  Honey- 
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well  procedures  can  be  viewed  with  confidence.  Unfortunately,  it  appears 
unlikely  that  the  overall  approach  advocated  by  Honeywell  can  be  upgraded 
sufficiently  to  remediate  the  problems  it  faces.  The  validity  of  the 
approach  ultimately  relies  on: 

a.  the  judgments  of  individuals  who  must  speculate  3bout  the  Jemands 


of  a  system  that  is  neither  familiar  nor  well  specified; 
b.  invalid  or  untested  assumptions  about  the  nature  and  combinatorial 
characteristics  of  the  processes  producing  mental  workload. 


1.  LHX  mission  scenarios  are  reviewed  by  an  expert  military  helicopter 
pilot  to  identify  the  moment-to-moment  procedural  requirements  of 
flight  and  mission  management. 


2.  The  expert  elicitation  data  are  then  organized  into  Modified  Petri  Nets 
(MPNs),  a  form  of  network  scheduling  resembling  PERT  or  CPM.  The  MPN 
analysis  provides  representations  of  (a)  the  set  of  transitional  activ¬ 
ities  required  of  a  pilot  within  a  given  time  range  to  achieve  a  spec¬ 
ified  end  state,  and  (b)  the  end  state  achieved  through  each  transi¬ 
tional  activity,  or  combination  of  these.  The  MPN  analysis  represents 
transitional  activities  in  a  hierarchical  fashion  such  that  the  activ¬ 
ity  representation  at  a  given  level  of  abstraction  can  be  decomposed 
into  progressively  more  specific  sets  of  activities  and  end  states. 
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3.  A  further  expert  elicitation  is  used  to  estimate  the  range  of  tines 
required  by  the  pilot  to  complete  cech  transitional  a  tivity.  A  Monte 
Carlo  simulation  is  then  carried  out  to  establish  likely  activity 
concurrencies. 

4.  The  mental  workload  associated  with  each  activity  and  each  set  of  con¬ 
current  activities  is  determined  by  expert  judgment.  The  judgmental 
process  consists  of  the  expert  pilot  rating  on  a  relative  scale  (0  to 
100)  the  workload  demand  of  each  specified  activity  or  activity  con¬ 
currency. 

5.  The  procedure  for  identifying  functions  which  might  profit  from  automa¬ 
tion  is  not  clearly  indicated  in  the  Perceptronics  report,  but  presum¬ 
ably  would  be  responsive  to  the  high  workload  points  identified  during 
Step  4  above.  (In  the  1984  Perceptronics  report,  candidates  for  auto¬ 
mation  were  generated  on  the  basis  of  expert  opinion.  However,  as 
noted  in  the  report,  this  was  simply  an  expedient  since  description 

of  the  more  formal  procedures  recommended  for  this  determination  was 
beyond  the  scope  of  the  research  effort  reported). 

2.2.2  Critique  of  the  Perceptronics  Approach 

The  approach  recommended  by  Perceptronics  has  two  strongly  positive  fea¬ 
tures.  First,  all  phases  of  the  approach  entail  expert  input,  thereby 
increasing  the  fidelity  and  pilot  acceptability  of  the  outcome.  Second, 
the  use  of  the  MPN  methodology  to  represent  and  organize  expert  elicitation 
data  seems  an  especially  positive  feature,  yielding  the  same  obvious 
dividends  as  does  any  good  network  scheduling  device  in  planning  and  anal¬ 
yzing  resource  utilization  around  complex,  time-limited  operations. 
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Howe.er,  several  difficulties  exist  with  this  approach: 

1.  Since  the  pilot(s)  used  in  expert  elicitation  had  no  experience  in  the 
LHX  system,  the  elicited  estimates  of  transition  process  completion 
times  may  be  in  error.  Quite  probably,  the  calculation  of  process 
concurrencies  and  the  potential  points  of  maximum  workload  are  apt  to 
be  in  error. 

2.  Again,  because  the  experts  used  to  judge  the  workload  of  piloting  acti¬ 
vities  had  no  specific  experience  with  the  system,  the  accuracy  of 
their  workload  estimates  is  open  to  serious  question. 

3.  The  use  of  an  omnibus  100-point  workload  scale  is  a  questionable  prac¬ 
tice.  To  what  extent  does  a  scale  of  this  sort  yield  valid  and 
reliable  estimates,  even  under  optimal  conditions  of  judgment?  No  evi¬ 
dence'  is  cited  in  behalf  of  the  procedure.  If  supportive  evidence 
exists,  Bio-Dynamics  is  unaware  of  it. 

4.  No  explicit  effort  is  made  to  incorporate  knowledge  of  human  informa¬ 
tion  processing  capacities  and  limitations  into  the  Perceptronics  anal¬ 
ysis.  Rather,  the  analysis  relies  almost  exclusively  on  the  judgments 
and  opinions  of  expert  pilots,  organized  via  network  scheduling  tech¬ 
niques,  to  assess  crew  workload  and  to  identify  opportunities  for 
automation.  This  neglect  of  much  of  the  literature  of  the  cognitive 
sciences  greatly  compromises  the  conceptual  quality  of  the  approach. 

The  approach  recommended  by  Bio-Dynamics 

The  Honeywell  and  Perceptronics  groups  sought  to  develop  quantitative 
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measures  of  the  momentary  workload  likely  to  be  imposed  on  the  crew  of  a 
system  which  has  yet  to  be  realized  or  simulated,  and  for  which  no  genuine 
experts  exist.  As  argued  above,  the  efforts  of  both  groups  have  made 
positive  contributions  to  the  analysis  of  the  problem,  yet  have  fallen 
short  of  their  intended  goal.  The  reason  for  the  shortfall  probably  lies 
in  the  goal  sought.  Given  that  the  LHX  system  is  unrealized  and  indeed 
has  yet  to  be  well  specified  in  structure  and  function,  3nd  given  the 
unavailability  of  experienced  system  operators,  Bio-Dynamics  believes  it 
is  not  possible,  a  priori,  to  develop  and  apply  quantitative  workload 
measurement  procedures  that  will  tolerate  close  conceptual  and  method¬ 
ological  examination.  While  it  is  true  that  the  uncertainties  of  system 
mission  and  technology  will  achieve  some  resolution  in  the  near  term,  this 
reduces  the  problem  only  slightly. 

Based  on  analysis  of  the  problems  associated  with  prior  efforts  to  analyz 
likely  crew  workload  in  the  LHX,  Bio-Dyn3mics  recommends  a  different 
approach.  This  approach  does  not  have  as  its  goal  the  generation  of  quan¬ 
titive  workload  estimates.  Rather,  it  proceeds: 

1.  by  applying  principles  from  cognitive  and  human  performance 
psychology  to  create  information  display/control  suite  design 
alternatives  likely  to  minimize  pilot  workload; 

2.  by  comparatively  evaluating  these  alternatives  through  performance 
testing  under  conditions  of  low  fidelity  simulation;  and 

3.  by  recommending  the  automation  of  pilot  functions  within  the 
optimal  design  alternative  based  on  empirical  necessity. 
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This  approach  is  markedly  different  in  a  fundamental  way  from  those  advo¬ 
cated  by  Honeywell  and  Perceptronics.  3io-Dynamics  believes  that  the  LHX 
workload  problem  cannot  be  treated  adequately  by  a  priori  or  subjective 
analysis.  Rather,  it  will  be  i.icessary  to  combine  principle  and  subjective 
analysis  wirh  empirical  evaluation.  Bio-Dynamics  feels  strongly  that  this 
approach  will  provide  the  most  valid  solution. 

The  proposed  approach  entails  the  seven  steps  that  follow. 

3.1  Step  1;  Expert  elicitation 

The  objective  of  expert  elicitation  is  to  gain  from  seasoned  rotorcraft 
pilots  a  detailed  picture  of  the  information  gathering  and  control  activ¬ 
ities  likely  to  be  associated  with  flight  and  mission  management  for  each 
set  of  plausible  LHX  mission  scenarios.  Of  specific  interest  are  infor¬ 
mation  on  the  procedures’,  likely  activity  concurrencies,  task  priorities, 
performance  criteria,  and  action  consequences  that  determine  crew  perform¬ 
ance.  A  problem  immediately  arises  in  elicitations  at  this  level  of 
detail.  Available  experts  the  crewing  of  attack  helicopters  have  gained 
their  experience  in  craft  where  flight  and  mission  management  responsi¬ 
bilities  are  divided  between  two  crew  members,  a  pilot  and  a  gunner  (as 
in  the  AH-1G  or  S  series),  and  are  carried  out  in  the  context  of  infor¬ 
mation  display/control  suites  and  flight  dynamics  that  are  unique  to  those 
craft.  Based  on  interviews  with  a  rotorcraft  pilot  during  the  present 
project,  Bio-Dynamics  believes  this  problem  can  be  reduced  substantially 
by  asking  the  expert: 

1.  to  respond  to  elicitation  probes  based  on  the  supposition  of  a 
single  crew  craft; 
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2.  to  focus  both  on  the  abstract  nature  of  the  information  and  action 
required  at  the  moment  (as  distinct  from  the  specific  displays 

and  manipulanda  providing  them);  and  separate  from  this, 

3.  to  discuss  only  the  specific  instrumentation  with  which  he  is 
familiar. 

The  importance  of  the  informational  focus  is  that  it  enables  the  researcher 
to  define  the  generic  information  processing  demands  involved.  The  value 
of  the  instrumentation  focus  is  chat  it  can  provide  experience-based  clues 
relating  to  potentially  advantageous  and  disadvantageous  modes/forms  of 
information  presentation. 

To  gain  the  detailed  information  required  for  specification  of  relevant 
psychological  principles,  the  elicitation  procedure  should  include  the 
following  steps: 

1.  Using  the  timeline  analysis  of  Honeywell,  the  modified  Petri  Net  pro¬ 
cedure  of  Perceptronics,  or  other  network  scheduling  device,  the  expert 
is  first  asked  to  translate  LHX  mission  scenarios  into  a  flow  of 
specific  crew  activities.  It  should  be  noted  that  with  scenarios  as 
non-specific  as  those  provided  Honeywell  and  Perceptronics,  significant 
individual  differences  should  be  expected  among  pilots  regarding  the 
specifics  of  their  scenario  translations.  This  variability  probably 
reflects  the  entreprenurial  norms  of  the  culture  of  U.S.  military 
pilots.  Tables  la  and  lb  illustrate  the  point.  Table  la  was  derived 
by  Bio-Dynamics  from  the  expert  timeline  analysis  of  three  LHX 
scenarios  carried  out  by  Honeywell  (1982).  The  table  shows  the 
frequency  of  all  task  concurrencies  identified  during  expert  elici¬ 
tation  by  the  Honeywell  group.  Table  lb  contains  the  pattern  and 
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Table  lb,  continued 


Request  status  information 
Review  status  information 
Speech  recognition  feedback 


frequency  of  concurrencies  occurring  within  the  same  scenarios,  but 
this  time  as  envisioned  by  the  expert  used  by  Bio-Dynamics.  The 
following  preliminary  information  was  provided  for  Bio-Dynamics'  pilot 
expert  to  constrain  his  analysis: 

1.  a  copy  of  the  three  scenarios  used  with  the  Honeywell  expert; 

2.  a  description  and  picture  of  the  baseline  information  display/ 
control  suite  recommended  by  the  Honeywell  group  and  other  mater¬ 
ial  relating  to  the  LHX  mission  and  capabilities;  and 

3.  a  timeline  containing  major  events,  way  points,  and  flight  modes 
added  by  the  Honeywell  group  to  the  basic  scenarios  provided  to 
them  by  Boeing  Vertol  (for  example,  ZSU  detection  and  engagement, 
D1VARTY  call  and  damage  assessment,  and  Hind  detection  and  engage¬ 
ment). 

It  will  be  noted  from  a  comparison  of  the  two  tables  that  a  sizable 
difference  in  scenario  analysis  exists  between  the  two  experts,  even  with 
the  constraints  listed  above.  While  not  totally  unexpected,  this 
between-expert  variation  must  be  taken  into  consideration  in  designing 
procedures  for  the  acquisition  and  analysis  of  elicitation  data. 

2.  Once  the  sequencing  and  concurrencies  of  scenario-related  crew  activi¬ 
ties  or  tasks  has  been  established,  more  detailed  probing  can  be 
initiated.  The  following  probes  are  examples  of  those  that  should 
prove  useful  in  elaborating  the  processing  demands  pertaining  to  each 
identified  crew  task: 

a.  Perceptual  information  required  to  carry  out  the  activity.  What 
is  the  natural  source  (modality,  locus)  o.  _.ie  information 
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required,  and  whac  is  Che  nature  of  the  information  itself?  For 
some  tasks,  little  option  exists  regarding  the  modality  and  rela¬ 
tive  locus  of  required  information  (as  in  the  task  of  NOE  flight). 
For  other  tasks,  options  exist  in  the  modality  and/or  location 
of  required  information  (as  with  system  status  information, 
systems  failure  information,  threat  warning  information,  and  the 
like).  This  distinction  is  a  significant  one  because  it  helps 
to  define  the  design  constraints  and  opportunities  to  be  subjected 
to  principled  analysis  at  subsequent  points  in  the  proposed  pro¬ 
cedure.  The  same  distinction,  with  the  same  design  implications, 
applies  to  the  nature  (form)  of  the  required  information  (e.g., 
alphanumeric  vs.  graphic,  visual  displays,  or  tonal  fre¬ 
quency-coded  vs.  speech-coded  auditory  signals).  For  cases  in 
which  information  modality  or  form  is  optional,  the  expert  can 
be  usefully  probed  regarding  possible  preferences  and  the  reasons 
for  them. 

b.  Mental  operations  (computations,  analyses,  judgments)  required 
to  complete  the  activity.  Much  of  the  logically  or  theoretically 
necessary  mental  operations  underlying  the  performance  of  complex 
cognitive  tasks  a/e  inaccessable  to  awareness  (Ericsson  &  Simon, 
1980).  However,  many  are,  particularly  those  that  are  especially 
demanding  of  attention,  reflect  conscious  computations,  or  involve 
rote  (check  list)  procedures.  Efforts  undertaken  to  retrieve  the 
expert's  understanding  of  the  mental  operations  necessary  to 
complete  specified  activities  are  efforts  well  spent.  When 
combined  with  principled  analyses  described  in  later  sections  of 
the  report,  this  information  can  provide  valuable  hints  about  the 
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mental  models  used  by  the  expert,  and  therefore  the  most  effective 
way  to  present  information. 


Action  required  to  complete  the  activity.  Of  the  43  scenario 
related  piloting  tasks  identified  by  Honeywell,  28  tasks  required 
some  sort  of  overt  action;  either  manual  or  vocal.  The  15  (asks 
that  require  no  overt  action  entail  the  monitoring  of  infor¬ 
mational  source,  external  or  internal  to  the  craft.  The  possi¬ 
bility  exists  that  this  monitoring  will  uncover  data  requiring 
overt  action;  however,  in  such  cases  the  call  for  action  entails 
a  separately  defined  task.  Of  those  28  tasks  requiring  overt 
action,  some  are  locked  into  a  particular  response  modality  (as 
in  flight  control  tasks),  whereas  others  exhibit  some  flexibility 
in  the  response  assignment  they  can  accept  (as  in  sensor  selection 
or  target  hand-off).  Where  options  exist,  the  expert  should  be 
probed  regarding  his  perspective  on  the  relative  advantages  and 
disadvantages  of  each  option.  Here,  as  in  the  case  of  information 
display  optionality,  an  understanding  of  the  locus  and  extent  of 
output  optionality  should  have  important  implications  fcr  system 
design  constraints  and  opportunities. 

Once  the  information  outlined  Above  has  been  obtained  for  all 
piloting  activities  associated  within  the  scenarios  under  analy¬ 
sis,  probes  pan  be  directed  toward  identified  instances  of  task 
concurrency.  The  following  probes  will  be  of  use  in  defining  the 
processing  demands  and  implications  of  each  n-wise  task  currency: 

1 .  Are  there  unique  qualities  of  information  acquisitions,  men- 


tal  i  ;  ..rations,  or  actions  for  task  A  that  are  special  to 
the  fact  that  it  is  paired  with  task  B?  For  instance,  are 
the  perceptual/cognitive/action  demands  of  external  ob¬ 
servation,  damage  assessment,  TMD  check,  or  TMD  update  diff¬ 
erent  in  NOE  flight  than  in  contour  cr  ise?  How  specifically 
do  the  demands  differ? 


What  is  the  appropriate  stategy  for  treating  the  demands  of 
each  identified  concurrency?  That  is,  which  activity  has 
the  higher  priority?  Are  the  tasks  sequenced  or  should  the 
pilot  attempt  to  carry  them  out  simultaneously?  Under  the 
conditions  specified  in  the  scenario,  can  completion  of 


either  or  both  tasks  be  delayed,  and  if  so,  for  how  long? 


For  each  concurrency,  how  could  pilot  performance  be  degrad¬ 
ed  relative  to  situations  in  which  the  component  tasks  or 
activities  are  carried  out  in  isolation?  For  example,  does 
the  possibility  increase  under  concurrent  conditions: 

(a)  th»t  the  cue  signaling  task  A  (or  B)  will  be  missed  or 
detected  with  unacceptable  delay; 

(b)  that  the  total  processing  demands  of  all  n  concurrent 
tasks  cannot  be  completed  within  acceptable  time  limits; 

(c)  that  performance  deadlines  will  force  incomplete  percep¬ 
tual  or  cognitive  analysis  leading  to  incorrect  or 
imprecise  action;  or 

(d)  that  performance  on  one  or  both  tasks  will  be  degraded 

by  cross-talk  within  response  modalities  or  cross-masking 
within  sensory  modalities? 


4.  For  each  concurrency,  what  are  the  potential  consequences  of 
the  performance  degradations  described  in  (3)  above  for 
mission  accomplishment?  For  example,  how  important  is  it  to 
-  ensure  that  degradation  is  minimized  or  eliminated? 

Two  summary  comments  are  in  order  regarding  the  relationship  between  the 
elicitation  procedure  outlined  above  and  those  carried  out  in  the  Honeywell 
and  Perceptronics  analyses.  First,  Bio-Dynamics’  suggested  procedure  will 
produce  relatively  greater  detail  on  perceived  task  characteristics  and 
demands  in  addition  to  the  expert'  rategic  reactions  to  these.  This 
added  detail  should  enhance  the  analyst’s  ability  at  later  stages  to 
identify  and  map  relevant  psychological  principles  into  the  workload 
problem  domain  within  the  LHX.  Second,  the  Bio-Dynamics  elicitat'on  proce¬ 
dure  does  not  seek  to  extract  from  experts  a  numerical  judgment  of  the 
workload  demands  of  specific  tasks  (as  in  Honeywell)  or  task  concurrencies 
(as  in  Perceptronics).  For  reasons  elaborated  above,  quantitative  judg¬ 
ments  of  this  sort  have  questionable  validity  under  the  special  circum¬ 
stances  surrounding  the  LHX  system.  Rather,  the  recommended  approach  is 
to  seek  from  skilled  pilots  qualitative  information  pertaining  to  tasks 
and  demands  and  to  use  this  information  tc  guide  or  form  hypotheses  useful 
in  subsequent  analyses.  The  following  sections  will  discuss  these  analyses. 

2  Step  2:  Principled  analysis  of  crew  workload  problems  posed  by  the  LHX 
systems /miss ion. 

At  the  conclusion  of  Step  1,  the  analyst  will  have  available: 

a.  a  substantial  amount  of  information  regarding  the  functional 
qualities  of  the  LHX  system  understood  at  the  time  the  analysis 
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is  conducted; 

b.  the  information  processing  demands  potentiated  by  the  system 
mission  on  its  crew;  and 

c.  the  strategic  implications  of  these  as  perceived  by  experts  know- 
ledgable  in  the  piloting  of  other  attack  helicopter  systems. 

The  ultimate  aim  of  the  Step  2  analysis  is  to  isolate  principles  available 
in  Che  literatures  of  cognitive  and  human  performance  psychology  that  are 
relevant  to  the  potential  workload  problem  faced  by  the  LHX  pilot  (as 
revealed  in  the  information  generated  at  Step  1),  and  to  use  these  prin¬ 
ciples  to  make  recommendations  on  LHX  information  display/control  suite 
design  and  automation. 

However,  the  mapping  of  principles  into  the  LHX  pilot  workload  problem  will 
be  challenging.  Two  examples  illustrate  the  complexity  of  the  problem. 

In  discussing  the  relative  merits  of  auditory  and  visual  forms  of  infor¬ 
mation  presentation,  Deatherage  (:972)  stated  a  number  of  recommendations 
which  in  fact  reflect  established  principles.  He  recommended  that  (a)  if 
the  message  is  simple,  use  auditory  presentation,  and  if  complex,  use 
visual  presentation;  (b)  if  the  message  is  short,  use  auditory  presen¬ 
tation,  and  if  long,  use  visual  presentation;  and  (c)  if  the  visual  system 
is  over-burdened,  use  auditory  presentation,  and  if  the  receiving  location 
is  acoustically  noisy,  use  visual  presentation.  While  valid  as  general 
observations,  of  what  practical  value  are  such  principle-based  recommen¬ 
dations  in  any  given  design  situation?  How  do  researchers  know  a  priori 
that  a  message  is  sufficiently  "shcrt"  or  "simple"  to  conclude  in  favor 
of  auditory  presentations?  How  do  analysts  know  a  priori  whether  the 


visual  system  is  sufficiently  overloaded  to  conclude  in  favor  of  audic^ry 
presentation?  Additionally,  many,  perhaps  most,  design  commitments  reflect 
uncertain  trade-offs.  For  example,  suppose  the  acoustic  environment  in 
which  messages  are  received  is  noisy,  but  nessages  are  short,  or  simple. 

How  can  the  designer  decide  a  priori  between  visual  and  auditory  presen¬ 
tation  or  between  unimodal  and  bimodal  presentation?  The  problem  arises 
that  even  if  what  is  meant  by  a  ’'simple"  message  could  be  stated  more 
precisely,  there  are  often  no  data  or  other  valid  bases  for  deciding  how 
this  variable  interacts  or  trades-off  with  other  factors  operative  in  a 
real  system. 

Given  these  difficulties  and  others  of  similar  kind,  any  type  of 
"principled"  analysis  of  workload  and  workload  minimization  must  be  vali¬ 
dated  by  empirical  means.  More  specifically,  it  can  be  expected  that  an 
analysis  of  the  kind  proposed  will  yield  design  arguments  of  varying  force. 
Some  will  have  strong  and  direct  support  in  the  research  literature,  others 
will  be  hypotheses  that  must  be  verified  by  empirical  test.  The  empirical 
validation  issue  will  be  discussed  in  Steps  3,  4,  6  and  7. 

3.2.1  Conceptual  framework  for  analysis 

The  intent  in  this  section  is  to  describe  a  general  conceptual  framework 
for  organizing  and  applying  cognitive  principle  to  the  LHX  problem. 

Because  this  framework  constitutes  a  set  of  general  theoretical  claims 
about  the  nature  of  the  human  information  processing  system,  it  will 
generate  some  controversy.  The  framework,  which  may  be  thought  of  as  a 
cognitive  systems  approach,  begins  with  the  following  general  claims: 

1.  The  flow  of  information  between  stimulus  and  response  is  through  a  set 
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of  cognitive  sub-systems  whose  constitution  is  determined  by  the  modal¬ 
ity  of  input,  the  modality  of  output,  and  the  nature  of  the  transforma¬ 
tions  required  to  map  input  into  output  (Wickens,  Mountford  and 
Schreiner,  1981). 

Use  of  a  limited  capacity  subsystem  (attention)  is  required  to  select 
specific  stimuli  as  bases  for  action  and  to  organize  and  carry  out 
transformations  underlying  the  mapping  of  stimuli  into  actions.  The 
attentional  subsystem  functions. in  a  manner  analogous  to  a  spotlight 
(Laberge,  1973),  which  can  be  directed  to  differentially  facilitate 
or  to  enable  processing  activity  within  specific  subsystem  pathways. 

Decrements  in  performance  under  dual  task,  relative  to  single  task, 
conditions  can  result  from  either  of  two  central  events:  (a)  struc¬ 
tural  (or  processing)  interference  within  subsystems,  occurring  when  . 
two  tasks  create  simultaneous  patterns  of  activation  within  one  or 
more  common  subsystems  (Navon,  1984);  and/or  (b)  simultaneous  demand 
for  the  limited  capacity  attentional  subsystem. 

Decrements  in  performance  under  dual,  relative  to  single  task  condi¬ 
tions,  also  can  result  from  either  of  at  least  two  classes  of  peri¬ 
pheral  events: 

a.  sensory  masking,  in  which  processes  at  or  very  near  the  receptor 
surface  are  simultaneously  activated  by  stimuli  from  the  two 
different  tasks,  yielding  a  confluence  of  activity  that  may  be 
difficult  or  impossible  to  analyze  into  its  separate  constituents; 
and 

b.  in  the  case  of  vision  (a  directional  sensory  system  with  steep 
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spatial  acuity  gradients),  decrements  will  result  when  acquisition 
of  the  stimulus  for  one  task  requires  a  retinal  orientation  that 
prevents  acquisition  of  or  reduces  acuity  for  the  stimulus  of  the 
other  task. 

As  a  simplifying  assumption,  attentional  utilization  is  treated 
as  an  all-or-nothing,  rather  than  divisible,  process.  The  atten¬ 
tional  mechanism  is  construed  as  a  source  of  activation  which, 
when  applied  to  already  active  neural  codes,  (e.g.,  those  driven 
by  external  stimuli),  will  boost  their  excifatory  outputs  to 
associated  "down  stream"  codes  (e.g.,  motor  programs),  thereby 
increasing  the  probability  the  latter  will  be  triggered.  The 
assumption  that  attentional  utilization  is  all-or-nothing  means 
that  the  attentional  mechanism,  like  a  spotlight,  may  be  directed 
to  one,  and  cnly  one,  code  at  a  given  instant  in  time  boosting 
activity  levels  for  that  code  and  to  a  graded  degree  all  codes 
which,  by  prior  learning,  are  linked  to  it. 

3.2.2  The  identification  and  application  of  cognitive  human  performance  for 
the  design  of  I.HX/pilot  interfaces 

The  examples  given  above  illustrate  and  frame  some  of  the  kinds  of  work¬ 
load-related  problems  which  might  profitably  be  addressed  through  careful 
application  of  principles  drawn  from  cognitive  and  human  performance 
psychology.  In  this  section  principles  useful  for  LHX/piiot  interface 
design  will  be  illustrated.  The  principles  discussed  constitute  only  a 
small  portion  of  those  that  will  prove  relevant  to  the  problem.  The 
development  of  a  more  complete  listing  awaits  research  extending  beyond 
the  scope  of  the  current  study. 
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Reiucing  attentional  dwell  time.  One  class  of  principles,  whose  relevance 
surfaced  in  the  material  presented  in  the  preceding  section,  concerns 
means  by  which  the  duration  of  the  attentional  demand  imposed  by  piloting 
tasks  in  the  LHX  can  b>  minimized.  All  else  being  equal,  the  less  the 
attentional  (or  controlled)  processing  time  demanded  by  a  task,  the  more 
quickly  the  attentional  mechanism  will  be  free  to  service  the  demands  of 
other  demanding  tasks.  Stimulus-response  (S-R)  compatibility,  the 
familiarity  of  "naturalness"  of  the  stimulus-response  mapping  imposed,  is 
a  major  determinant  of  the  total  attentional  dwell  time  required  by  a  task. 
As  a  general  rule,  the  higher  the  compatibility  between  stimuli  and  their 
associated  responses,  the  shorter  the  central  processing  time  required  to 
effect  the  S-R  mapping.  The  prolonged  processing  time  observed  under 
conditions  of  low  compatibility  is  often  interpreted  as  the  result  of  com¬ 
peting  response  tendencies;  that  is,  competition  between  required  responses 
and  inclinations  to  initiate  more  familiar  (but  now  inappropriate) 
responses.  Human  factors  and  human  performance  psychologists  (e.g.,  Fitts 
and  Seeger,  1953;  Loveless,  1963;  Vidulich  and  Wickens,  1982)  have  summar¬ 
ized  a  number  of  principles  pertaining  to  S-R  compatibility,  included  among 
them  are  the  following: 


1.  Spatial  correspondence  between  stimuli  and  associated  loci  of 


action.  The  principle  is  that  the  arraneement  cf  stimuli  in  space 


should  correspond  to  the  spatial  arraneement  of  the  actions 


required  by  them.  This  principle  reflects  what  appears  to  be  a 
very  basic  tendency  to  move  toward  a  source  of  visual  stimulation 
(Simon,  1969),  and  to  respond  more  rapidly  and  accurately  when 


the  spatial  arrangement  (left-right,  top-bottom)  of  responses 


correspond  to  Chose  of  stimuli,  even  when  stimuli  and  action  loci 
are  well  separated  in  space.  (Cotton,  Tzeng  &  Hardyck,  1980; 
Hartzell,  Dunbar,  Beveridge  &  Cortilla,  1982).  A  classic  demon¬ 
stration  of  the  behaviorial  effects  of  spatial  compatibility  with 
complex  arrays  w> s  reported  by  Fitts  and  Seeger  (1953).  The  study 
utilized  eight  stimuli  and  eight  responses,  but  as  illustrated 
*.:i  Figure  1,  the  stimuli  and  responses  were  of  varying  forms. 
Stimulus  sat  A  consisted  of  a  circle  of  8  lights,  any  one  of  which 
Could  illuminate  on  a  given  trial.  Set  B  had  four  lights  arranged 
as  a  diamond.  Any  one  light  could  come  on  (four  alternatives) 
or  any  adjacent  pair  could  come  on  (four  more  alternatives).  Set 
C  also  had  four  lights,  two  in  a  horizontal  line  and  two  in  a 
vertical  line.  Any  of  the  four  lights  could  come  on  alone  or  any 
of  the  four  combinations  of  one  horizontal  and  one  vertical  light 
could  come  on.  There  were  also  three  response  sets.  Subjects  held 
one  stylus  for  sets  A  and  B,  and  two  styluses  for  set  C.  The 
styluses  were  moved  along  tracks  as  indicated  in  the  figure.  In 
set  C,  subjects  either  moved  one  or  two  styluses  on  a  trial 
depending  on  whether  one  or  two  lights  illuminated.-  The  key 
finding  is  that  reaction  times  and  accuracy  are  determined  by  the 
relationship  between  stimulus  and  response  sets,  rather  than  by 
stimulus  or  response  sets  per  se.  The  more  compatible  the  spatial 
relations  between  stimuli  and  responses,  the  better  the  obtained 
performance.  The  magnitude  of  the  spatial  compatibility  effects 
reported  in  laboratory  (Fitts  and  Seeger,  1953)  and  applied 
settings  (Hartzell,  et  al,  1982),  and  the  fact  that  under  stress, 
higher  compatible  but  incorrect  responses  can  replace  less  com¬ 
patible  but  correct  ones,  points  to  the  extreme  importance  of  this 
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Stimulus  Set 


Figure  1 


Reaction  time  and  percentage  of  errors  for  different  combinations 
of  stimuli  and  responses  (afier  Fitts  and  Seeger,  1953) 
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factor  in  the  layout  of  the  LHX  information  display/control  suite. 


Compatibility  as  population  stereotype.  While  S-R  compatibility 
by  spatial  correspondence  appears  to  be  pre-programmed  into  the 
nervous  system,  other  kinds  of  compatibility  appear  to  be  more 
a  function  of  experience,  as  indicated  by  their  cultural  depen¬ 
dence.  This  type  of  preferred  S-R  correspondence  is  called  a  popu¬ 
lation  stereotype.  Several  forms  of  population  stereotypy  have 
been  identified. 

A.  Display  control  stereotypy.  Loveless  (1963)  has  summarized 
findings  on  the  nature  of  population  stereotypes  in  display- 
control  relations,  generating  several  principles  of  potential 
relevance  to  the  present  problem. 

1.  Clockwise  stereotype.  There  is  a  basic  tendency  to 
rotate  a  dial  clockwise  in  order  to  create  a  change  in 
the  state  of  an  associated  display  variable. 

2.  Clockwise-to-increase  stereotype.  A  stereotype  exists 
to  rotate  a  dial  clockwise  or  move  a  linearly  moveable 
indicator  to  the  right  or  upwards  to  increase  the  value 
on  a  display. 

3.  Proximity  of  movement  stereotype.  With  any  rotary  con¬ 
trol,  the  arc  of  the  rotating  element  that  is  nearest 

to  the  moving  indicator  should  move  in  the  same  direction 
as  the  indicator.  Thus,  for  instance,  a  rotary  control 


located  beneath  a  horizontal  linear  display  should  be 
rotated  clockwise  to  produce  a  rightward  displacement 
of  the  displayed  indicator. 

A.  Congruence  stereotype.  Linear  movements  of  displays  and 
controls  should  be  along  the  same  axis  and  in  the  same 
direction.  Rotational  movements  of  displays  and  controls 
should  be  in  the  same  direction. 

B.  Verbal-pictorial  stereotypy.  Smith  (3981)  reports  the 

results  of  a  questionnaire  study  investigating  population 
and  group  (engineers,  women,  and  Human  Factors  Society 
members)  preferences  regarding  the  relationship  between 
pictures  and  descriptive  words  or  phrases.  The  method  and 
results  of  this  demonstration  study  are  of  great  relevance 
tc  the  LHX  problem  for  both  the , selection  of  voice  interac¬ 
tive  and  radio  communication  phase  structures,  and  the  design 
of  visual  symbology.  Some,  examples  drawn  from  the  Smith  ques¬ 
tionnaire  are  as  follows:  ••  • 

1.  Question  3:  Flying  in  an  aircraft  cockpit,  the  co-pilot 
says  "Left  wing  down."  How  should  the  pilot  act  to 
change  his  roll  position? 

_ Lower  the  left  wing? 

_ Raise  the  right  wing? 
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2.  A  picture  is  shown  depicting  a  refrigerator  with  its  door 
open.  The  door  is  hinged  on  the  right,  facing  the 
refrigerator.  Question  7:  Here  is  a  refrigerator.  Is 
its  door 

_ Left  opening? 

_ Right  opening? 

3.  (A  picture  is  shown  of  a  river  extending  from  right  to 
left  with  arrows  indicating  a  left-to -right  current  flow 
On  the  upper  side  of  th'  river  in  the  drawing  is  a 
church.)  Question  11:  Here  is  a  river  flowing  from  East 
to  West.  Is  the  church  on  the 

_ Left  bank? 

_ Right  bank? 

4.  (A  square  is  shown)  Question  15;  An  adding  machine  is 
designed  to  be  operated  with  one  hand.  On  the  pane  to 
the  left  draw  in  how  you  consider  its  keys  should  be 
positioned  for  the  10  numerals. 

The  results  of  the  questionnaire  showed  that  for  some  kinds  of 
questions  (e.g.,  number  15)  high  levels  of  agreement  appear 
across  population  sub-groups,  whereas  with  other  questions  (num¬ 
ber  3)  low  agreement  exists  between  or  across  sub-groups.  While 
it  is  not  currently  possible  to  make  broad  statements  of  prin¬ 
ciple  regarding  cultural  stereotypy  for  verbal-pictorial  rela¬ 
tions,  the  kinds  of  results  obtained  by  Smith  indicate  the  desir- 
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ability  of  empirically  evaluating  the  issue  with  respect  to 
specific  systems  interfaces  and  user  populations. 

Compatibility  of  input-output  modality.  Somet ime  ago  Brainard, 
Irby,  Fitts,  and  Alluki  (1962)  reported  that  r-action  time  to  a 
visual  stimulus  is  faster  when  the  response  is  manual  rather  than 
vocal,  but  when  the  stimulus  is  an  auditory  symbol,  a  vocal 
identification  response  is  quicker  than  one  that  is  manual.  This 
basic  relation  —  the  higher  compatibility  of  auditory-vocal  and 
visual-manual  over  auditory-manual  and  visual-vocal  mappings  — 
tends  to  hold  up  across  a  variety  of  conditions  (Teichner  and 
Krebs,  1974);  Hawkins  and  Rodriguez,  1981).  It  appears  that  when 
the  feedback  produced  by  a  response  is  in  the  same  sensory 
modality  as  the  stimulus  giving  rise  to  the  response,  the  S-R 
mapping  can  be  carried  out  relatively  more  quickly  than  otherwise 
(c.f.,  Greenwald  and  Schulman,  1973). 

Transformational  complexity  as  3ttentional  demand.  Numerous  fac¬ 
tors  influence  the  complexity  of  the  information  transformation 
required  between  stimuli  and  responses.  Indeed,  S-R  compatibil¬ 
ity  should  be  viewed  as  one  sub-class  of  such  factors.  Another 
important  sub-class  consists  of  the  informational  properties  for 
the  task,  e.g.,  the  number  and  relative  frequencies  of  alternative 
S-R  correspondences  and  the  extent  to  which  sequential  depen¬ 
dencies  exist  among  stimuli  (Hyman,  1963).  A  particularly 
important  set  of  factors  relates  to  the  degree  to  which  the 
meaning  (environmental  referent)  of  a  signal  can  be  interpreted 
without  extensive  transformation.  In  general,  the  more  direct 
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the  relation  between  a  signal  and  its  environmental  referent,  the 


more  rapidly  it  will  be  interpreted.  For  example,  the  speed  and 
accuracy  of  an  individual's  interpretation  of  an  auditory  alarm 
signal,  particularly  under  conditions  of  stress,  will  be  higher 
if  the  signal  is  a  word  or  word  phrase  rather  than  a  tone,  hum, 
or  chime  of  3  particular  frequency,  amplitude,  or  periodicity. 

5.  Increasing  the  speed  and  probability  of  signal  detection.  A  second 
critical  determinant  of  performance  apparent  in  Figure  1  is  the  speed 
and  probability  with  which  critical  (action  demanding)  signals  are 
detected.  The  faster  the  detection  of  a  critical  stimulus,  the  greater 
will  be  the  likelihood  that  the  stimulus  will  be  analyzed  and  acted 
upon,  both  accurately  and  prior  to  possible  response  deadlines.  Expert 
•  elicitation  is  a  valuable  source  of  information  on  which  to  base  design 
strategies  aimed  at  maximizing  the  speed  with  which  critical  signals 
are  enhanced,  lata  such  as  those  summarized  in  Figures  la  and  lb, 
reveal  where  stimulus  concurrencies  are  apt  to  appear  in  the  LHX 
system/mission,  and  thus,  where  special  attention  must  be  given  to  the 
problems  of  . signal  detection  under  perceptual  overload. 

For  purpose  of  illustration,  consider  the  problem  of  timely  and 
accurate  detection  of  critical  visual  cues.  The  demands  of  modern 
military  aviation  impose  a  substantial  load  on  the  pilot's  visual 
system,  perhaps  at  or  near  the  point  of  saturation.  Th»  visual  infor¬ 
mation  processing  demands  of  NOE  flight  in  the  LHX  are  e»/en  more  acute, 
involving  on  an  ongoing  basis: 

1.  the  detection  and  analysis  of  environmental  factors  relevant  to 

i 

path  selection  (obstacles,  backdrops,  location  of  friendly  craft, 
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surface  covering,  and  the  like); 

2.  the  detection  and  analysis  of  potential  targets/ground  threats; 

3.  the  frequent  assessment  of  information  contained  on  head-down 
displays  such  as  the  terrain  map  display  and  the  multi-function 
CRT  display. 

Under  these  conditions,  the  loci  of  potentially  critical  visual  information 
extend  across  a  range  far  exceeding  the  spatial  limits  of  the  visual 
system's  effective  sensitivity.  An  important  first  step  in  the  analysis 
of  the  problems  posed  here  is  to  conduct  expert  elicitation  to  determine 
the  nature,  priority,  and  spatial  origins  of  potentially  critical  visual 
information;  the  likelihood  of  possible  concurrencies  among  signals 
containing  this  information;  and  possible  sequential  dependencies  among 
signals.  These  "link-an3lytic"  data,  combined  with  other  information  such 
as  whether  or  not  signals  of  a  particular  type  or  origin  can  be  registered 
electronically;  the  anticipated  visual  and  auditory  complexity  of  the 
pilot's  environment;  and  the  nature  of  signals  to  which  the  system  is 
already  committed;  can  serve  to  guide  decisions  about  issues  such  as  the 
following: 

a.  Whether  to  enhance  signal  detectability  by  electronic  means; 

b.  Whether  to  employ  visual,  auditory  or  tactile  modality  as  the 
channel  through  which  the  detection-enhancing  signal  is  trans¬ 
mitted  to  the  pilot; 

c.  Where  to  locate  various  head-down  displays  relative  to  the  pilot's 
head-up  line-of-sight; 

d.  Where  to  locate  signal  enhancing  symbology  within  the  head-up 
display; 


e.  How  much  redundancy  to  include  in  signaling  systems  for  highly 
critical  information;  and 

f.  The  nature  of  the  electronically  generated  signal  (word,  phrase, 
tone,  horn,  buzzer  or  bell). 

In  summary,  the  objective  of  the  second  step  of  the  recommended  procedure 
is  to  identify  principles  and  analytic  methods  in  the  literature  of  cogni¬ 
tion  and  human  performance  that  are  relevant  to  the  workload  problem  anti¬ 
cipated  for  the  LHX  pilot,  and  to  apply  these  to  the  conceptualization  of 
a  baseline  avionics/display  and  control  suite  for  the  system.  The  attempt 
in  this  section  of  the  report  h3s  been  to  offer  a  general  theoretical 
framework  and  to  illustrate  principles  and  analytic  methodologies  of  the 
types  that  can  emerge  from  the  more  intensive  research  effort  proposed. 

Step  3:  Development  of  low-cost,  low  or  mixed  .fidelity  simulations 
As  noted  earlier,  the  current  state  of  knowledge  in  cognition  and  human 
performance  does  not  permit  unequivocal  conclusions  regarding  all  or  even 
most  design  features  of  complex  man-machine  interfaces.  While  much  is 
known  about  the  determinants  of  performance  overall,  available  psycho¬ 
logical  principles  can  be  extended  to  touch  only  a  portion  of  the  problem. 
The  effects  of  variables  in  isolation  are  understood,  but  less  is  under¬ 
stood  about  how  variables  combine.  In  particular,  the  details  of  how 
conflicting  variables  trade-off  with  one  another  are  not  yet  known. 

For  these  reasons,  the  analysis  carried  out  at  Step  2  will  produce 
questions  nearly  as  often  as  answers.  However,  the  proposed  methodology 
should  produce  questions  that  are  well  defined,  contained,  and  empirically 
resolvable,  often  in  the  form:  is  A  mode  (or  form)  of  signal  presentation 


better  than  B  in  the  context  of  moderating  variables  C  and  D?  A  might  be 
visual,  B  auditory,  C  an  acoustic  environment  with  specified  parameters, 
and  D  a  visual  environment  with  specified  parameters. 

The  objective  of  Step  3  would  be  to  produce  low-cost  computerized  simula¬ 
tions  of  the  alternative  solutions  suggested  as  plausible  by  the  analysis 
carried  out  in  Step  2..  These  simulations  can  be  relatively  low  in  cost 
if  they  can  be  designed  to  contain  simulacre  of  only  a  small  portion  of 
the  LHX  system  (in  the  instance  above,  only  A,  B,  C  and  D,  which  in  prin¬ 
ciple  wholly  define  the  set  of  relevant  factors).  Of  course  they  must  also 
contain  the  capacity  to  score  task  performances  along  dimensions  that  by 
common  sense  or  principle  are  most  relevant  to  the  task(s)  involved.  It 
should  be  apparent  that  the  total  number  of  simulations  required  by  this 
analysis  may  be  fairly  large. 

3.4  Step  4:  Testing  on  low-cost  simulations 

The  objective  of  Step  4  is  to  compare  empirically  the  alternatives  identi¬ 
fied  at  Step  2  and  manifested  in  the  simulations  developed  at  Step  3.  The 
results  of  this  comparison  will  be  an  identified  set  of  information  presen¬ 
tation  and  control  rrodes/forms  yielding  the  most  effective  single  and  con¬ 
current  task  performance  (as  defired  by  the  single  and  dual  task  perfor¬ 
mance  criteria  specified  at  Steps  1  and  2)  among  those  alternatives  consid¬ 
ered.  Thus,  the  arguments  to  be  made  from  data  taken  at  Step  4  are  rela¬ 
tive:  that  is,  they  are  of  the  form,  "performance  on  task  combination  A 
and  B  is  better  when  task  A  information  is  presented  in  mode  X  as  opposed 
to  Y  or  2".  However,  since  the  simulations  producing  these  results  will 
not  be  high  in  fidelity,  it  would  be  inappropriate  to  draw  conclusions 


45 


about  absolute  levels  of  performance.  Accordingly,  it  would  be  inappro¬ 
priate  to  conclude  from  the  results  of  Step  4  that  a  particular  function 
ought  to  be  automated  because  the  function  is  too  highly  disruptive  of  per¬ 
formance  on  functions  (tasks)  concurrent  with  it.  This  latter  issue  will 
be  addressed  in  Steps  5,  6,  and  7. 

3.5  Step  5:  Configuration  of  high  fidelity  simulation 

The  objective  of  Step  5  is  to  implement  the  optimal  solutions  identified 
at  Step  4  as  components  in  a  high-fidelity  simulation  that  can  be  used  for 
evaluation  of  automation  needs  within  the  LHX  system.  The  assumption  un¬ 
derlying  this  step  is  that  neither  subjective  judgments  drawn  from  pilots 
whose  experience  is  in  helicopters  systems  other  than  the  LHX,  nor  analy¬ 
sis  based  on  the  application  of  psychological  principles  to  judgmental  data 
elicited  from  expert  pilots,  seems  sufficients  priori  to  produce  sound 
decisions  regarding  automation.  To  the  contrary,  the  most  valid  procedures 
for  determining  which  LHX  pilot  functions  to  automate  are  those  based  on 
analysis  of  the  performance  and  subjective  judgments  of  pilots  functioning 
within  an  implemented  system  whose  workload  demands  simulate  those  antici¬ 
pated  within  the  LHX  . 

3.6  Step  6;  Performance  testing  in  baseline  LHX  simulator 

The  information  display/control  su'te  of  the  simulator  configured  at  Step 
5  will  be  a  baseline  suite  in  the  sense  that  it  will  contain  no  automated 
pilot  functions.  The  objective  of  Step  6  is  to  conduct  performance  testing 
with  skilled  pilots  to  gather  performance  data  and  expert  judgments  that 
can  be  used  to  guide  decisions  on  automation.  If  skilled  helicopter 
pilots,  trained  on  the  baseline  simulator,  fail  to  perform  the  constituents 
of  u  set  of  concurrent  tasks  within  specified  tolerances,  then  some 


member(s)  of  the  concurrent  set  should  be  considered  for  automation. 


3.7  Step  7:  Modification  and  ^-evaluation  of  the  LHX  simulator 

Based  on  performance  data  and  pilot  assessments  from  Step  6  and  on  techno¬ 
logical  feasibility,  certain  pilot  functions  in  the  baseline  simulator  will 
be  "automated";  that  is,  their  automation  will  be  simulated.  Shilled 
pilots  will  then  be  tested  on  the  up-graded  simulator  to  determine  whether 
or  not  the  automation  enables  desired  levels  of  perform;nce.  Based  on  the 
results  of  this  evaluation,  further  system  tuning  will  be  carried  out  as 
necessary. 

4.0  Conclusion 

Bio-Dynamics  believes  that  the  seven  step  program  outlined  in  the  preceding 
section  offers  a  viable,  cost-effective  means  to  address  three  critical 
LKX-related  issues: 

a)  the  extent  and  nature  of  pilot  potential  workload  demands  imposed 
under  feasible  alternative  information  display  /control  solutions 
within  the  LHX  system; 

b)  the  feasibility  of  a  single  pilot  solution  to  the  LHX  crewing 
issue;  and 

c)  the  necessity  and  nature  of  function  automation  within  one  and 
two  crew  solutions. 

The  first  five  steps  of  the  proposed  program  can  be  completed  within  one 
and  a  half  years  by  a  single  contractor  with  continuous  access  to  a  small 


number  of  experienced  attack  helicopter  pilots,  and  computer  systems 
programmers  capable  of  developing  the  low-cost  simulations  described  in 
Steps  2  and  3.  Completion  time  for  Steps  6  and  7  will  be  contingent  upon 
the  development  and  accessibility  of  high  fidelity  l.HX  simulators. 
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